Exploiting the Shapley Value in the Estimation of the Position of a Point of Interest for a Group of Individuals

Concepts and tools from cooperative game theory are exploited to quantify the role played by each member of a team in estimating the position of an observed point of interest. The measure of importance known as “Shapley value” is used to this end. From the theoretical point view, we propose a specific form of the characteristic function for the class of cooperative games under investigation. In the numerical analysis, different configurations of a group of individuals are considered: all individuals looking at a mobile point of interest, one of them replaced with an artificially-generated one who looks exactly toward the point of interest, and directions of the heads replaced with randomly-generated directions. The corresponding experimental outcomes are compared

Towards a multimodal repository of expressive movement qualities in dance

In this paper, we present a new multimodal repository for the analysis of expressive movement qualities in dance. First, we discuss guidelines and methodology that we applied to create this repository. Next, the technical setup of recordings and the platform for capturing the synchronized audio-visual, physiological, and motion capture data are presented. The initial content of the repository consists of about 90 minutes of short dance performances movement sequences, and improvisations performed by four dancers, displaying three expressive qualities: Fluidity, Impulsivity, and Rigidity

Designing multimodal interactive systems using EyesWeb XMI

This paper introduces the EyesWeb XMI platform (for eXtended Multimodal Interaction) as a tool for fast prototyping of multimodal systems, including interconnection of multiple smart devices, e.g., smartphones. EyesWeb is endowed with a visual programming language enabling users to compose modules into applications. Modules are collected in several libraries and include support of many input devices (e.g., video, audio, motion capture, accelerometers, and physiological sensors), output devices (e.g., video, audio, 2D and 3D graphics), and synchronized multimodal data processing. Specific libraries are devoted to real-time analysis of nonverbal expressive motor and social behavior. The EyesWeb platform encompasses further tools such EyesWeb Mobile supporting the development of customized Graphical User Interfaces for specific classes of users. The paper will review the EyesWeb platform and its components, starting from its historical origins, and with a particular focus on the Human-Computer Interaction aspects

An Open Platform for Full Body Interactive Sonification Exergames

This paper addresses the use of a remote interactive platform to support home-based rehabilitation for children with motor and cognitive impairment. The interaction between user and platform is achieved on customizable full-body interactive serious games (exergames). These exergames perform real-time analysis of multimodal signals to quantify movement qualities and postural attitudes. Interactive sonification of movement is then applied for providing a real-time feedback based on "aesthetic resonance" and engagement of the children. The games also provide log file recordings therapists can use to assess the performance of the children and the effectiveness of the games. The platform allows the customization of the games to address the children's needs. The platform is based on the EyesWeb XMI software, and the games are designed for home usage, based on Kinect for Xbox One and simple sensors including 3-axis accelerometers available in low-cost Android smartphones

Development and validation of an art-inspired multimodal interactive technology system for a multi-component intervention for older people: a pilot study

IntroductionThe World Health Organization (WHO) acknowledges the presence of a significant body of research on the positive effects of the arts on health, considering a variety of factors including physical well-being, quality of life, and social and community impact. The model that underlies cultural welfare puts the performing arts, visual arts, and cultural heritage at the service of people personal and societal well-being. The potential connections between movements of the body and artistic content have been extensively studied over time, considering movement as a non-verbal language with a universal character.MethodsThis pilot study presents the results of the validation of an innovative multimodal system, the DanzArTe-Emotional Wellbeing Technology, designed to support active and participative experience of older people providing physical and cognitive activation through a full-body physical interaction with a traditional visual work of art of religious subject. DanzArTe supports a replicable treatment protocol for multidimensional frailty, administered through a low cost and scalable technological platform capable of generating real-time visual and auditory feedback (interactive sonification) from the automated analysis of individual as well as joint movement expressive qualities. The study involved 45 participants, 23 of whom participated in the DanzArTe program and 22 who were included in the control group.ResultsThe two groups were similar in terms of age (p = 0.465) and gender (p = 0.683). The results showed that the DanzArTe program had a positive impact on participants' self-perceived psychological health and well-being (Mean Psychological General Well-Being Index—Short T1 = 19.6 ± 4.3 Vs. T2 = 20.8 ± 4.9; p = 0.029). The same trend was not observed in the control group (p = 0.389).DiscussionThe findings suggest that such programs may have a significant impact particularly on the mental and social well-being of older adults and could be a valuable tool for promoting healthy aging and improving quality of life

Enhancing children understanding of mathematics with multisensory technology

Recent results from psychophysics and developmental psychology show that children do not integrate and use the same sensory modalities in the same way, but they rather have a preferential sensory channel to learn specific concepts. In schools, however, the visual channel is often the only one exploited for teaching, whereas the other channels are left to a marginal role. The weDRAW project, an ongoing European two-years project, explores the chance to create and evaluate new methodologies to teaching, grounded on multisensory technologies. In particular, the project targets a deeper understanding of arithmetic and geometry. A major novelty of such a new technology is that it is based on the renewed understanding of what communication between senses is and how it occurs during child development, that is, that specific sensory systems have specific roles for learning specific concepts. Neuroscientific prospectives suggest that it is possible to develop new teaching/learning channels, personalized for each student based on the child's sensory skills. This practice work consists of a demo simulating a set-up in a primary school, where children with any level of previous mathematical knowledge can try the technologies themselves. The demo includes full-body activities to "play" and "draw" arithmetical and geometrical concepts, such as playing a fraction using body rhythms and drawing shapes and symmetries

The energy lift: Automated measurement of postural tension and energy transmission

This abstract presents a computational model and a software library for the EyesWeb XMI platform to measure a mid-level movement quality of particular importance to convey expressivity: Postural Tension. A whole body posture can be described by a vector containing the angles between the adjacent lines identifying feet (the line connecting the barycentre of each foot), knees, hip, trunk, shoulders, head, and gaze (eyes direction). Postural Tension is the extent at which a movement exhibits rotation of these multiple horizontal planes including spirals. The abstract presents a definition of this mid-level quality, and describe a demonstration: movement of a user is captured with a low-cost wearable device, postural tension and transmission of energy through the body are then extracted, visualized and sonified

Active Experience of Audiovisual Cultural Content: the Virtual Binocular Interface

This paper describes the main novel developments which have been introduced and experimented with in \u201cViaggiatori di Sguardo\u201d, a permanent interactive installation. The objectives and resulting interaction design choices are briefly explained, and the system architecture briefly sketched. Then, the paper focuses on the novel full-body pointing interaction mechanism based on the mimicking of the use of binoculars. The permanent installation \u201cViaggiatori di Sguardo\u201d was opened on December 2009 at Palazzo Ducale, Fondazione per la Cultura, Genova, and has been visited up to now by about 5,000 visitors. Results from the evaluation of such a novel interface are presented, and future developments briefly discussed